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Abstract 


In  this  report,  short  space  Implementation  of  Image  restoration 
systems  such  as  Wiener  filtering  to  avoid  the  Image  non-statlonarlty 
problem  Is  discussed.  It  Is  demonstrated  by  way  of  examples  that  short 
space  Implementation  leads  to  a  significant  performance  Improvement  In 
reducing  wlde-band  random  noise  relative  to  the  traditional  approach  In 
which  the  entire  Image  Is  processed  by  a  linear  space  Invariant  filter. 
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I. 


INTRODUCTION 


There  exist  a  number  of  practical  situations  In  which  the  restoration 
of  a  degraded  Image  Is  Important  and  consequently  the  problem  of  Image 
restoration  has  received  considerable  attention  In  the  literature  (1,2). 

In  many  cases  such  as  Wiener  filtering  (3),  power  spectrum  filtering  (4), 
etc. ,  the  restoration  techniques  are  based  on  the  assumption  that  an  Image 
can  be  modelled  by  a  stationary  random  field,  and  restoration  Is  achieved 
by  filtering  the  degraded  Image  with  a  linear  space  Invariant  restoration 
filter. 

For  a  typical  Image,  each  part  of  an  Image  generally  differs  suffi¬ 
ciently  from  other  parts  so  that  the  statlonarlty  assumption  over  the  entire 
Image  Is  not  generally  valid.  One  approach  to  reduce  the  effect  of  the 
non-statlonarlty  problem  Is  to  Implement  a  restoration  filter  on  a  short- 
space  basis  In  which  an  Image  Is  divided  Into  many  subimages  and  each  sub¬ 
image  is  restored  separately  and  then  combined.  The  notion  to  Implement  an 
Image  restoration  system  on  a  short-space  basis  to  reduce  the  Image  non- 
statlonarlty  problem  has  been  considered  In  the  literature  (5,6,7).  For 
example.  Hunt  and  Trussel  (5)  segmented  the  Image  by  overlapping  two 
dimensional  (2-0)  rectangular  windows  for  an  MAP  Image  restoration  system. 
Urn  (6)  segmented  the  Image  by  overlapping  2-D  separable  triangular  windows 
for  a  spectral  subtraction  Image  restoration  system.  Even  though  the 
Importance  of  short-space  processing  has  been  observed  In  the  context  of 
specific  recent  Image  restoration  techniques.  It  has  not  been  demonstrated 
In  the  more  traditional  restoration  techniques  such  as  Wiener  filtering. 

In  this  note,  we  demonstrate  by  way  of  examples  that  short-space  Imple¬ 
mentation  can  noticeably  enhance  the  performance  of  well  known  Image 
restoration  techniques  such  as  Wiener  filtering. 

In  section  II,  we  discuss  the  model  of  Image  degradation  considered 
In  this  note  and  the  Wiener  filtering  technique  for  Image  restoration.  In 
section  III,  we  discuss  short-space  Implementation  of  Wiener  filtering.  In 


section  IV,  Me  Illustrate  and  discuss  various  examples  which  demonstrate  the 
Importance  of  short-space  processing  for  Image  restoration  by  Wiener  filtering. 


II.  IMAGE  DEGRADATION  MODEL  AND  WIENER  FILTERING 

The  degradation  that  will  be  considered  In  this  note  Is  additive 
random  noise.  Specifically,  a  degraded  Image  y(nj,n2)  Is  represented  by 


y(n1,n2)  =  f(nltn2)  +  d^.ng)  (1) 

where  f(n-,,n2)  Is  a  noise-free  Image  and  d(n1,n2)  Is  additive  random  noise 
uncorrelated  with  f(n1,n2).  The  restoration  problem  Is  to  restore 
f(n1tn2)  from  the  degraded  Image  y(n^,n2). 

If  f(n.|,n2)  and  d(n.,,n2)  are  assumed  to  be  samples  of  stationary 
random  fields  uncorrelated  with  each  other,  then  the  optimum  linear  filter 
which  minimizes  the  mean  square  error  between  f(nltn2)  and  the  processed 
Image  Is  the  non-causal  Wiener  filter  whose  frequency  response  H(<d1  ,u>2)  Is 
given  by 


/  ,  ^*f(ul  ,u>2  ^ 

H(w1‘w2)  "  Pf(u)1,u)2i  V  Pd(u>1  ,a»2) 


(2) 


In  equation  (2),  Pf(u1,u)2)  and  P^uyuig)  represent  the  power  spectrum  of 
the  Image  and  degrading  random  noise  respectively. 


Image  restoration  based  on  equation  (2)  requires  a  priori  knowledge  of 
,cd2)  ancl  .u>2).  In  some  applications  (8,9),  is  known 

exactly  and  in  many  others  (2)  the  estimation  of  ,u>2)  Is  relatively 
simple.  In  this  note,  we  assume  that  P^u^.u^)  is  known  a  priori.  To 
estimate  P^(o)-|  ,to2) ,  a  common  procedure  used  is  to  average  the  spectral 
density  over  many  different  Images  or  prototype  Images.  Alternatively, 

P^(o>1  ,u>2)  could  be  estimated  by 

P^(aj-|  ,a>2)  =  S[k  •  I  Y(o).|  ,0)2)  1 2  -  P^taj-I  ,o>2)]  (3) 

where  Y(a>1,(i)2)  Is  the  discrete  space  Fourier  transform1  of  y(n^,n2), 

"k"  is  a  normalization  constant  between  power  and  energy  spectrum  and  "S" 
is  some  form  of  smoothing  operation.  Subtraction  of  Pd(<i)-|  ,w2)  reduces 
the  bias  due  to  the  noise  power  and  the  smoothing  operation  reduces  (10)  the 
variance  of  the  spectral  estimate.  Estimating  Pf(u»1,w2)  In  a  manner  similar 
to  equation  (3)  has  the  advantage  that  the  estimated  P^(u>i,w2)  is  derived 
from  some  aspect  of  the  signal  f(n^,n2)  and  consequently  is  data-adaptive. 

2 

Once  H(w1,w2)  Is  determined,  f(n^ ,n2)  Is  typically  estimated  by 

ffn^)  =  F*1  (Y(u)1  ,u>2)  •  Hfu,,^)]  (4) 

1.  Definitions  for  various  terms  such  as  discrete  space  Fourier  transform, 
power  spectrum,  and  energy  spectrum, and  determination  of  the  normal izati 
constant  "k"  can  be  found  in  (6,10). 

2.  Since  equation  (4)  is  Implemented  using  the  Discrete  Fourier  Transform 
(DFT)  and  Inverse  Discrete  Fourier  Transform  (IDFT),  some  aliasing  may 
occur  at  the  Image  boundaries.  Such  aliasing  can  be  reduced  by  In¬ 
creasing  the  size  of  the  DFT  and  IDFT.  The  smoothing  operation  In 
equation  (3)  also  reduces  the  aliasing  problem,  since  from  equation  (2) 
a  smoother  spectral  estimate  of  Pf(w,*>2)  generally  corresponds  to  a 
shorter  unit  sample  response  of  the  fesDltlng  filter. 


where  ?(n-j,n2)  represents  an  estimate  of  f(n-|,n2)  and  F'1  represents  the 
inverse  discrete  space  Fourier  transform  operation.  The  implementation  of 
non-causal  Wiener  filtering  by  equation  (4)  corresponds  to  processing  the 
entire  image  with  a  linear  space  invariant  filter.  As  will  be  discussed  In 
section  IV,  the  performance  of  this  Implementation  Is  poor  in  reducing 
additive  random  noise  partly  due  to  the  Image  non-statlonarlty  problem. 

III.  SHORT  SPACE  IMPLEMENTATION 

To  reduce  the  effect  of  the  Image  non-statlonarlty  problem,  a  reason¬ 
able  approach  is  to  Implement  Wiener  filtering  on  a  short  space  basis  In 
which  the  degraded  image  Is  divided  Into  many  subimages  and  each  subimage 
is  restored  separately  and  then  combined.  One  such  approach  Is  to  first 
apply  a  short  space  window  function  w^(n^,n2)  to  y(n^,n2)  in  equation  (1) 
so  that 

y(n1,n2)  •  “  ^(ni  *  w1j*nl  ,n2^ 

+  d (n-j  ,n2)  •  wij(n1,n2) 

Denoting  y(n1,n2)  •  ,n2)  by  y^  j(n1  ,r»2 )  and  using  similar  notation 

for  the  remaining  two  terms,  equation  (5)  can  be  written  as 


Equation  (6)  Is  Identical  In  form  to  equation  (1).  By  substituting  the  roles 
of  f(n1,n2),  d(nltn2)  and  y(n-,,n2)  in  equation  (1)  for  f‘1  j (n1  ,n2> ,  d^(n1,n2) 
and  y^jfnj.ng)  in  equation  (5),  the  discussions  In  section  II  can  be  applied 
to  estimate  fij(n1,n2)  from  y^fn^rig).  Since  the  essence  of  short  space 
processing  Is  data-adaptlve  filtering,  the  estimation  of  P^(u>i,to2)  from 
yi  j ^nl  *n2 )  *n  constructing  should  be  performed  in  a  manner  similar 

to  equation  (3).  Once  each  subimage  fjj(nj,n2)  is  estimated,  the  entire 
image  can  be  constructed  by 


f(n-j  ,n2)  s  I  I  f  1  j ( ni  «n2) 
i  j 


(7) 


To  successfully  Implement  Wiener  filtering  on  a  short  space  basis, 
the  window  function  w1j(n-|,n2)  must  be  carefully  chosen.  For  example, 
to  reconstruct  an  Image  from  its  subimages  by  equation  (7),  w^(n1,n2)  has 
to  satisfy  the  following  equation; 


E  E  Wjjfn^.ng)  =  1  for  all  n^,n2  of  interest.  (8) 

1  d 


In  addition,  w-j j (ni  »n2)  is  desired  to  be  a  smooth  function  to  avoid 
some  possible  discontinuities  or  degradations  that  may  appear  at  the 
subimage  boundaries  In  the  processed  Image.  Two  window  functions  which 
have  the  above  properties  are  2-D  separable  triangular  or  Hamming  window 
overlapped  with  its  neighboring  window  by  half  the  window  duration  in  each 
dimension  (6). 
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In  summary,  in  estimating  f(n-j  ,n2)  from  y(n.j,n2)  by  short  space  imple¬ 
mentation  of  Wiener  filtering,  we  first  divide  y(n^,n2)  into  subimages  and 
the  non-causal  Wiener  filter  is  applied  separately  to  each  subimage.  The 
resulting  subimages  are  then  combined  to  form  an  estimate  of  f(nj,n2).  In 
the  next  section,  we  illustrate  by  way  of  examples  the  performance  improve¬ 
ment  that  can  be  achieved  by  short  space  implementation. 


IV.  EXAMPLES  AND  DISCUSSIONS 

In  this  section,  we  illustrate  and  discuss  various  examples  which 
demonstrate  the  importance  of  short  space  processing  for  image  restoration 
by  Wiener  filtering.  In  Figure  1  are  shown  two  noise-free  images  of 
256  x  256  pixels  with  each  pixel  represented  by  8  bits.  In  Figure  2  are 
shown  two  degraded  images  at  S/N  ratio  of  10  dB  that  were  generated  by 
adding  zero  mean  white  Gaussian  noise  to  the  images  of  Figure  1.  The 
Gaussian  noise  was  digitally  generated  and  S/N  ratio  is  defined  by 

Variance  of  f(n1 ,n2) 

S/N  ratio  ■  10.  log  Variance  of  d(n,-.n;)  (9 


In  Figure  3  are  shown  typical  images  obtained  by  filtering  the  degraded 
images  of  Figure  2  with  a  linear  space  invariant  non-causal  Wiener  filter. 

In  Figure  4  are  shown  the  results  of  short  space  implementation  of  a  non- 
causal  Wiener  filter. 

In  estimating  the  image  power  spectrum  Pj.(u>j,u>2)  to  generate  the 
images  in  Figure  3,  a  variety  of  different  ways  including  those  discussed 
in  section  I  have  been  considered.  In  all  cases,  we  have  observed  that  the 
background  noise  can  be  noticeably  reduced  only  at  the  expense  of  noticeable 
blurring  of  the  resulting  Images.  The  images  shown  in  Figure  3  are  typical 
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Fig.  3.  Images  in  Fig.  2  processed  by  a  space 
invariant  Wiener  filter. 


Fig.  4.  Images  in  Fig.  2  processed  by  short  space 
implementation  of  a  Wiener  filter. 


■£v. 


examples.  This  seriously  diminishes  the  usefulness  of  Wiener  filtering  In 
reducing  background  noise  In  the  context  of  Image  restoration. 

The  Images  In  Figure  4  were  obtained  by  estimating  the  power  spectrum 
of  each  subimage  In  a  manner  similar  to  equation  (3)  so  that  the  estimated 
power  spectrum  Is  data  adaptive.  The  subimage  size  (window  size)  used  In 
the  short  space  Implementation  Is  8x8  pixels  for  the  "clock"  picture  and 
32x32  pixels  for  the  "aerial  view  of  a  vlllaqe"  picture  and  the  window 
shape  used  Is  a  2-0  separable  triangular  window.  The  subimage  size  was 
chosen  based  on  the  considerations  that  a  too  large  subimage  size  has  the 
image  non-statlonarlty  problem  and  a  too  small  subimage  size  leads  to  per¬ 
formance  degradation  due  to  the  lack  of  available  data  to  process.  For  the 
types  of  Images  that  we  considered  such  as  the  two  Images  used  In  this  note, 
the  subimage  size  in  the  range  of  8x8  pixels  to  32x32  pixels  produced  the 
best  results. 

For  all  the  Images  In  Figures  3  and  4,  the  amount  of  noise  reduction 
computed  corresponds  to  S/N  ratio  Improvement  of  approximately  4  or  5  dB  in 
the  normalized  mean  square  sense  (8).  The  traditional  approach  of  Wiener 
filtering  achieves  this  noise  reduction  at  the  expense  of  noticeable  blurring 
of  the  resulting  images.  Short  space  Implementation,  however,  achieves  the 
same  noise  reduction  with  significantly  less  blurring  of  the  resulting  images 
than  the  traditional  approach. 

Even  though  the  performance  obtained  by  short  space  Implementation 
of  Wiener  filtering  Is  clearly  superior  to  that  obtained  by  the  tra¬ 
ditional  Wiener  filtering  approach  In  the  context  of  Image  restoration, 
the  usefulness  of  short  space  Wiener  filtering  In  Improving  Image  quality 
or  Intelligibility  when  the  degradation  Is  additive  noise  Is  difficult 
to  judge  from  the  comparison  of  Figures  2  and  4.  However,  In  those 
applications  In  which  S/N  ratio  Improvement  In  the  mean  square  sense 
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without  significant  image  blurring  is  important,  short  space  implementation 
of  Wiener  filtering  discussed  in  this  note  may  be  useful.  Furthermore,  there 
is  considerable  room  for  further  improvement  in  the  short  space  implementation 
technique.  For  example,  in  this  note  we  have  divided  an  image  into  sub¬ 
images  by  imposing  arbitrary  boundaries.  If  an  image  is  divided  into  sub¬ 
images  at  more  natural  boundaries  such  as  image  edges,  the  system  per¬ 
formance  may  improve.  These  and  other  potential  improvements  are  under 
consideration. 

In  this  note,  we  have  considered  short  space  processing  to  reduce  the 
image  non-stationarity  problem  in  Wiener  filtering.  In  addition  to  Wiener 
filtering,  we  have  also  considered  other  image  restoration  systems  such  as 
power  spectrum  filtering  (4),  geometrical  mean  filtering  (4),  etc.  which 
are  based  on  the  assumption  that  an  image  can  be  modelled  by  a  stationary 
random  field.  In  all  these  cases,  we  have  also  observed  that  short  space 
implementation  similar  to  fiat  discussed  in  this  note  leads  to  a  significant 
performance  improvement  over  the  traditional  approach  in  which  the  entire 
image  is  processed  by  a  linear  space  invariant  filter.  From  these  results, 
it  appears  that  any  image  restoration  system  based  on  the  stationarity 
assumption  of  an  image  will  benefit  from  short  space  implementation  in  which 
each  subimage  rather  than  the  entire  image  is  assumed  to  be  stationary. 
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